On the influence of selection operators on 
performances in cellular Genetic Algorithms 



D. Simoncini, P. Collard, S. Verel, M. Clergue 



00 ' 

O' 

o: 

Oh 

< 

in ■ 



< 
o 



> 

in 

oo 

o 
o 

oo 
O 



X 



Abstract — In this paper, we study the influence of the selective 
pressure on the performance of cellular genetic algorithms. 
Cellular genetic algorithms are genetic algorithms where the 
population is embedded on a toroidal grid. This structure makes 
the propagation of the best so far individual slow down, and 
allows to keep in the population potentially good solutions. 
We present two selective pressure reducing strategies in order 
to slow down even more the best solution propagation. We 
experiment these strategies on a hard optimization problem, 
the Quadratic Assignment Problem, and we show that there 
is a threshold value of the control parameter for both which 
gives the best performance. This optimal value does not find 
explanation on the selective pressure only, measured either 
by takeover time or diversity evolution. This study makes 
us conclude that we need other tools than the sole selective 
pressure measures to explain the performance of cellular genetic 
algorithms. 

Introduction 

The selective pressure can be seen as the ability for 
solutions to survive in the population. When the selective 
pressure is high, only the best solutions survive and colonize 
the population, allowing less time for the algorithm to 
explore the search space. Thus, the selective pressure has 
an impact on the exploration/exploitation trade-off: When it 
is too low, good solutions' influence on the population is 
so weak that the algorithm can't converge and behave as a 
random search in the search space. When it is too strong, the 
algorithm converges quickly and as soon as it is stuck in a 
local optimum it won't be able to find better solutions. 

Cellular Genetic Algorithms (cGA) are a subclass of Evo- 
lutionary Algorithms in which the population is embedded on 
a bidimensional toroidal grid. Each cell of the grid contains 
one individual (solution) and the stochastic operators are 
applied within the neighborhoods of each cell. The existence 
of such small overlapped neighborhoods guarantee the prop- 
agation of solutions through the grid and enhance exploration 
and population diversity [13]. Such a kind of algorithms is 
especially well suited for complex problems with multiple 
local optima [6], To avoid the algorithm to converge toward 
one local optimum, one should apply the right selective 
pressure on the population and find the best balance between 
exploitation of good solutions and exploration of the search 
space. 

Section 1 presents a state of the art on selective pressure in 
cGAs and introduces two selection operators. Section 2 com- 
pares the influence of the selection operators on the selective 
pressure. Section 3 gives a description of the benchmark used 
to analyze the algorithms. Section 4 presents a comparative 
study of performance of the algorithms. Section 5 is a study 
on the evolution of the genotypic diversity in the populations. 



Finally in section 6 we summarize and discuss the results of 
the paper. 

I. Cellular genetic algorithms and selective 

PRESSURE 

Several methods have been proposed to tune the selective 
pressure and deal with the exploration/exploitation trade-off 
in cGA. For instance, the size and shape of the cells neigh- 
borhoods in which the evolutionary operators are applied, 
has some influence. A bigger neighborhood will induce a 
stronger selective pressure on the population [10]. When 
trying to solve complex problems, with numerous local 
optima, one would try to slow down the convergence of 
the population. That is why we use in our algorithm a 
Von Neumann neighborhood which is the smallest symetric 
neighborhood that allows the convergence of the population. 

The shape of the grid also has an impact on the selective 
pressure [1], [3], [4]: thinner grids give a weaker selective 
pressure on the population. This solution's weakness is that 
there are not enough grid shapes for a fixed size of population 
to allow an accurate control of the selective pressure. 

The selective pressure can also be monitored by choosing 
an adequate selection operator. 

A. Stochastic tournament selection 

The stochastic tournament selection proposed by Goldberg 
is a binary tournament selection that doesn't guarantee the 
best solution to be selected. The stochastic tournament of 
rate r chooses two solutions from the neighborhood of a cell 
and selects the best one with probability 1 — r (the worst one 
with probability r). Real parameter r should be in [0; 1]. 

Given the definition of selective pressure, this selection 
operator explicitely gives a weaker selective pressure for 
increasing r values. As r is getting closer to 1, worse 
solutions increase their chances to be maintained in the 
population, which means the selective pressure is getting 
weaker. 

B. Anisotropic selection 

The Anisotropic selection is a selection method in which 
the neighbors of a cell may have different probabilities to 
be selected [12]. The Von Neumann neighborhood of a 
cell C is defined as the sphere of radius 1 centered at C 
in manhattan distance. The Anisotropic selection assigns 
different probabilities to be selected to the cells of the Von 
Neumann neighborhood according to their position. The 
probability p c to choose the center cell C remains fixed at 
g. Let us call p ns the probability of choosing the cells North 



(N) or South (S) and p ew the probability of choosing the 
cells East (E) or West (W). Let a S [— 1; 1] be the control 
parameter that will determine the probabilities p ns and p ew . 
This parameter will be called the anisotropic degree. The 
probabilities p ns and p ew can be described as: 
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Thus, when a — — 1 we have p elu = 1 — p c and p„ s = 0. 
When a — 0, we have p ns = p eM , and when a = 1, we have 
p„ s = 1 — p c and £> el0 = 0. In the following, the probability 
p c remains fixed at -|. 
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Fig. 1 

Von Neumann neighborhood with probabilities to choose 

each neighbor 



Figure 1 shows a Von Neumann Neighborhood with the 
probabilities to select each cell as a function of a. 

The Anisotropic Selection operator works as follows. For 
each cell it selects k individuals in its neighborhood (k £ 
[1; 5]). The k individuals participate to a tournament and 
the winner replaces the old individual if it has a better 
fitness or with probability 0.5 if the fitnesses are equal. 
When a — 0, the anisotropic selection is equivalent to a 
standard tournament selection and when a = 1 or a = - 1 
the anisotropy is maximal and we have an uni-dimensional 
neighborhood with three neighbors only. In the following, 
considering the grid symmetry, we will consider a G [0; 1] 
only: when a is in the range [-1;0] making a rotation of 90° 
of the grid is equivalent to considering a in the range [0;1]. 

II. Takeover time 

A common analytical approach to measure the selective 
pressure is the computation of the takeover time [9] [14]. 
It is the time needed for the best solution to colonize the 
whole population when the only active evolutionary operator 
is selection [5]. When the takeover time is short, it means 
that the best solution's propagation speed in the population 
is high. So, worse solutions' life time in the population is 
short and thus the selective pressure is strong. On the other 
hand, when the takeover time is high, it means that the best 
solution colonizes slowly the population, giving a longer 
lifetime to worse solutions. In that case, the selective pressure 
is low. So the selective pressure in the population is inversely 
proportionnal to the takeover time. 



In order to measure the takeover time, we place one 
solution of fitness 1 on a 20 x 20 grid. All the other solutions 
have a null fitness. Then we run the process and measure the 
time needed for the solution of fitness 1 to spread over the 
whole grid. 

We measured average takeover times over 1000 simula- 
tions for a cGA using a stochastic tournament selection, 
and for one using the anisotropic selection. The simulations 
are made on square grids of side 20. Figure [2] shows the 
results of these simulations. The takeover time increases 
when a increases in the case of a cGA using the anisotropic 
selection (figure 12a)). So the selective pressure is inversely 
proportional to a. On figure|2b) we can see that the takeover 
time increases as long as the probability r to select the worst 
solution in the stochastic tournament grows. This means 
that the selective pressure in the population is inversely 
proportional to r for a cGA using a stochastic tournament 
selection. 

The slope of the curve representing the takeover time as 
a function of a (fig. |2fa)) for values close to 1 is more 
important than the one of the curve representing the takeover 
time as a function of r (fig. Etb)). We can also notice that 
in the case of a cGA using stochastic tournament selection, 
the takeover time is defined when the probability to select 
the best solution is 0. The best solution still can colonize 
the population in this case since the two candidates for the 
tournament are selected by a random draw with replacement. 
In the case of a cGA using anisotropic selection, the takeover 
time is not defined for a — l.The anisotropic degree a is a 
continuous parameter and the curve representing the takeover 
time as a function of a is not bounded. 

III. The Quadratic Assignment Problem 

This section presents the Quadratic Assignment Problem 
(QAP) which is known to be difficult to optimize. The QAP 
is an important problem in theory and practice as well. It 
was introduced by Koopmans and Beckmann in 1957 and is 
a model for many practical problems [7]. The QAP can be 
described as the problem of assigning a set of facilities to a 
set of locations with given distances between the locations 
and given flows between the facilities. The goal is to place 
the facilities on locations in such a way that the sum 
of the products between flows and distances is minimal. 
Given n facilities and n locations, two n x n matrices 
D = [dij] and F = [fki] where dy is the distance between 
locations i and j and fki the flow between facilities k and 
I, the objective function is: 



$ = ^2^2 d p(i)p(j)h 



where p{i) gives the location of fa- 
cility i in the current permutation p. 
Nugent, Vollman and Ruml proposed a set of problem 
instances of different sizes noted for their difficulty [2]. 
The instances they proposed are known to have multiple 
local optima, so they are difficult for a genetic algorithm. 




TABLE I 
Average performance and Takeover times for a and r 
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Fig. 2 

Average takeover times for a cGA using anisotropic 

selection (a) and stochastic tournament selection (b) 



We experiment our algorithm on the instances nug30 (30 
variables), tho40 (40 variables) and sko49 (49 variables) 
from QAPLIB. 

Set up 

We use a population of 400 individuals placed on a 
square grid (20 x 20). Each individual is reprensented by a 
permutation of N where N is the size of an individual. The 
algorithm uses a crossover that preserves the permutations: 

• Select two individuals p\ and p2 as genitors. 
« Choose a random position i. 

• Find j and k so that pi(i) = P2U) and P2{i) = Pi{k). 

• exchange positions i and j from p\ and positions i and 
k from P2 ■ 

• repeat N/3 times this procedure where N is the size of 
an individual. 

This crossover is an extended version of the UPMX 
crossover proposed in [8]. The mutation operator consist in 
randomly selecting two positions from the individual and 



Instance 


Anisotropic selection 
Perf Val TO 


Stochastic tournament selection 
Perf Val TO 


Nug30 
Tho40 
Sko49 


6156. 3is. 6 0.92 65.7 

242788 98 8.4 0.94 75.3 

23537.2 55 .5 0.92 65.7 


6152.6i8.5 0.85 79.6 

243115n77.2 0.8 70.4 

23550.358 0.8 70.4 



exchanging those positions. The crossover rate is 1 and we 
do a mutation per individual. We perform 200 runs for each 
tuning of the two selection operators. An elitism replacement 
procedure guarantees the individuals to stay on the grid if 
they are fitter than their offspring. Each run stops after 2000 
generations for nug30 and tho40, and after 3000 generations 
for sko49. 

IV. Performances 

In this section we present performance results on the 
Quadratic Assignment Problem for a cGA using stochastic 
tournament and anisotropic selection operators. In [11] the 
authors show that there is an optimal value of a parameter 
for the anisotropic selection that gives optimal performance. 
We want to see if the same behaviour is observed with 
the stochastic tournament selection and then to compare the 
performance obtained for these two operators. 

Figures [3] |4] and [5] show performance obtained with 
the anisotropic and the stochastic selection operator on the 
QAP instances nug30, tho40 and sko49. We measure the 
performance by averaging the best solution found on each 
run for each value of anisotropy degree and stochastic rate. 

When the rate of the stochastic tournament selection and 
the anisotropic degree are null, the two algorithms are the 
same : A standard cGA with binary tournament selection. 
The selective pressure drops when the values of the control 
parameters of the two algorithms increase. In both cases 
we see that as the selective pressure drops, performance 
increases until a threshold value. Once this value is reached, 
the performance decreases. These threshold values give the 
best exploration/exploitation trade-off for this problem. In 
the following, the threshold values of parameters a and r 
are denoted a and r . 

Table 1 gives a and r for each instance of QAP and 
their corresponding takeover times (TO). Best performances 
are in bold and differences between performances of the 
two algorithms are statistically significant for each instance 
according to the Student's t-test. Differences in takeover 
times are also statistically significant. The algorithm using 
stochastic tournament selection is the best for nug30, and 
the one using anisotropic selection is the best for tho40 
and sko49. The threshold values stand in the same ranges 
for all instances: a € {0.92,0.94} and r £ {0.8,0.85}. 
The differences in takeover times indicate that the selective 
pressure on the population is different for the two methods 
for the settings that give the best average performance. 
These differences can be explained by the way the algorithm 
explores the search space and exploits good solutions. 
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Fig. 3 

Performance of cGA with anisotropic selection for different 

anisotropy degrees (a) and with stochastic tournament for 

different rates (b) on instance nug30 



Fig. 4 

Performance of cGA with anisotropic selection for different 

anisotropy degrees (a) and with stochastic tournament for 

different rates (b) on instance tho40 



V. Diversity 

In this section, we present statistic measures on the evolu- 
tion of the genotypic diversity in the population. Three kinds 
of measures are performed : The global average diversity, 
the vertical/horizontal diversity and the local diversity. The 
global average diversity measure is made on a set of 50 runs 
of one instance of QAP for each kind of algorithm. It consists 
in computing the genotypic diversity between each solutions 
generation after generation. 

gD = fe^ ^ ^ d(x riCl ,Xr 2 c 2 ) 
W " n,r2ci,c 2 

where d(x\, X2) is the distance between solutions x\ and X2 ■ 
The distance used is inspired from the Hamming distance: It 
is the number of locations that differ between two solutions 
divided by their length n. 

The results for each generation are averaged on 50 runs. 
We obtain a curve representing the evolution of the global 



diversity in the population through 2000 generations. 

The vertical/horizontal diversity measures the average di- 
versity in the columns and in the rows of the grid. The 
vertical (resp. horizontal) diversity is the sum of the average 
distance between all solutions in the same column (resp. row) 
divided by the number of columns (resp. rows): 

W-D = — — 3 2^ Z^ d \ X rci 7 x rc 2 ) 



hD 



zrnc 



1 1 



/ . / . d\ x rici x r 2 c) 



c r\,r 2 

where (jr and jjc are the number of rows and columns in 
the grid. 

This measure is only made for the cGA with anisotropic 
selection. As the stochastic tournament selection provides 
an isotropic diffusion of solutions, the difference between 
horizontal and vertical diversities is null. 
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Fig. 5 

Performance of cGA with anisotropic selection for different 

anisotropy degrees (a) and with stochastic tournament for 

different rates (b) on instance sk049 
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Fig. 6 

Evolution of global diversity for a cGA using anisotropic 

selection (a) and stochastic tournament seletion (b) on 

instance nug30 



Figure [6] shows the evolution of global diversity for 
different settings of the anisotropic selection (fig |6ja)) and 
the stochastic tournament selection (fig |6{b)). Curves on 
figure |6|a) represent diversity for increasing values of a from 
bottom to top. These curves show that the more a is high, the 
more the diversity is maintained in the population. Similar 
results are obtained in the case of the stochastic tournament 
on figure[6|b). These curves represent diversity for increasing 
values of r from bottom to top. The shape of the curves are 
different for the two methods: For the stochastic tournament, 
the curves are concave in a first time and then become 
convex. For high values of r, the concave phase is longer 
and it is not finished at generation 2000 for values above 0.8. 
For the anisotropic selection, the convexity does not change, 
the curves are convex. 

The differences in the evolution of genotypic diversity are 
shown on figure [7] This figure present the evolution of the di- 
versity for the threshold values of the two algorithms: a and 



r . We can see that the diversity is higher for the algorithm 
using the stochastic tournament selection. Nevertheless, since 
the curve of the stochastic tournament is concave and the 
curve of the anisotropic selection convex, the difference of 
diversity starts to decrease around generation 1000 and at 
generation 2000 the algorithm using anisotropic selection has 
preserved more diversity. 

On figure [8] the horizontal diversity is plotted as a function 
of the vertical diversity for different settings of anisotropic 
selection. The straight line is the curve obtained for a = 
and a is increasing on curves from the left to the right. As a 
increases, the algorithm favors the propagation of solutions 
in the columns of the grid and the vertical diversity decreases 
quicker. On the other hand the horizontal diversity decreases 
slower, and is constant for the limit case a = 1. In the 
latter case, there are no interactions between the columns 
of the grid and the algorithm behave as several independant 
algorithms executing in parallel. These algorithms run on 
grids of width 1 and with 3 solutions in the "vertical" 
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Fig. 7 
Evolution of global diversity for a and r on instance 

NUG30 
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Fig. 8 

Horizontal diversity as a function of vertical diversity for 

different settings of a cga using anisotropic selection on 

instance nug30 



neighborhoods. 

The local diversity measure is computed on one single 
run for each kind of algorithm. It is the genotypic diversity 
observed in the neighborhood of each cell of the grid. 
It is represented as "snapshots" of the population, where 
a dark point represents a high degree of diversity in the 
neighborhood, and a clear point represents a low degree of 
diversity in the neighborhood. 

Figure [9] represents the local diversity along generations 
for a cGA with standard binary tournament selection. We can 
see on snapshots of generations 300 and 500 the formation of 
circles. Each circle contains copies of good solutions found 
locally. The frontier between the areas from which good 
solutions colonize the grid are the only sites on the grid 
where the crossover operator still can have some effect. At 



generation 1000 the genotypic diversity on the grid is null 
, the population has been colonized by one solution, and 
performance will not improve anymore. 

Figure [TOl represents the local diversity along generations 
for a cGA with stochastic tournament selection. The prob- 
ability of selecting the best participant to the tournament is 
decreasing from top to bottom. The first thing we notice is 
that the propagation mode of good solutions is the same as 
for the cGA using a standard binary tournament selection. 
The only difference is the speed of propagation of good 
solutions monitored by the r parameter. As long as we 
give less chances to the best solution in the neighborhood 
to be selected, it will take more time before the algorithm 
converges. The areas where crossovers can help to explore 
the search space and to improve performance are bigger 
when r increases. The crossover operator does not have 
any effect in the white zones of the grid since there is no 
more genotypic diversity in such areas. For r = 1, we see 
that at generation 1500 the diversity is still very high and 
the algorithm does not exploit good solutions because the 
selective pressure on the population is too low. 

Figure fTTI represents the local diversity along generations 
for a cGA with anisotropic selection. Values of a increase 
from top to bottom. By monitoring the anisotropy degree, 
we can influence on the dynamics of propagation of good 
solutions. For low values of a, good solutions roughly 
propagate in circles as for a cGA using binary tournament 
selection. When a reaches values close to 1, the good 
solutions tend to colonize the columns of the grid. The 
diversity is conserved between the columns, which indicate 
that the algorithm converge toward different solutions in each 
columns. Thus, the anisotropic selection favors the formation 
of subpopulations in the columns of the grid [11]. Crossovers 
between subpopulations then allow the algorithm to explore 
the search space, as long as the probability of selecting 
participants from different columns for the tournament is 
not too low (i.e. a is not too high). When a is too high, the 
selective pressure on the population is too low and negatively 
affects performance. 

VI. Discussion 

In this section we summarize and discuss the results on 
takeover time, performance and genotypic diversity and we 
compare the cGAs using anisotropic selection and stochastic 
tournament selection. Two cGAs using different selection 
operators have been tested on instances of QAP. The two 
selection operators allow to control the selective pressure on 
the population. The analysis of takeover time and genotypic 
diversity show the influence of the two operators on the 
selective pressure. 

When looking at the performance on QAP, we can see that 
on each instance and for both methods, the performance in- 
creases as the selective pressure drops down until a threshold 
value of the control parameter. After this value, the perfor- 
mance decreases as the selective pressure continue to drop 
down. The threshold values of the control parameter stand 
in the same range on all instances for both of the methods. 



Nevertheless, we notice from table 1 that the takeover times 
are not similar for a and r . Consequently, the selective 
pressure induced on the population is different for the two 
algorithms. The observations on figure [7] are in adequation 
with this: The algorithm with stochastic tournament preserves 
more genotypic diversity for the threshold value than the one 
with anisotropic selection. The genotypic diversity measures 
were made on instance nug30 for which the cGA with 
stochastic tournament selection obtains the best performance. 
However, results on diversity put in evidence properties of the 
selection operators which are independant from the instance 
tested. 

The selective pressure is related to the explo- 
ration/exploitation trade-off. We conclude from the 
results presented in table 1 and figure [6] that studying the 
exploration/exploitation trade-off is insufficient to explain 
performance of cellular genetic algorithms. In cGAs, the 
grid topology structures the search dynamic. 
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Fig. 9 
Local diversity in the population along generations (left to right) for a cGA with standard tournament selection 
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Fig. 10 
Local diversity in the population along generations (left to right) for increasing r values of stochastic tournament(top to 

BOTTOM) 




Fig. 11 

Local diversity in the population along generations (left to right) for increasing a (top to bottom) 



The overlapped neighborhoods allow to control the diffu- 
sion of phenotypic and genotypic informations through the 
population. 

Figures [10] and QT| show that the algorithm with stochastic 
tournament or anisotropic selection exploit differently the 
structure of the grid. When using the anisotropic selec- 
tion, the algorithm can favor the propagation of solutions 
vertically. This structuration creates subpopulations in the 
columns of the grid, and solutions can occasionally share 
information with adjacent subpopulations. On the other side, 
the stochastic tournament selection provides an isotropic 
propagation of solutions. The algorithm can control the speed 
of the propagation by decreasing the probability to select the 
best participant to the tournament as genitor. The snapshots 
and the figures [6] and [7] show that the genotypic diversity in 
the population is influenced by the exploitation of the grid 
structure. 

The selection operator plays an important role in the explo- 
ration of the search space and in the exploitation of solutions. 
The two operators we compare allow to control the selective 
pressure. For r and a the selective pressure induced on 
the population gives the best ratio between exploration and 
exploitation. But this ratio is dependant of the exploration 
and exploitation dynamics of the algorithm. Thus, it is 
dependant of the selection operator used. The measures on 
genotypic diversity and the snapshots show these differences 
whether the algorithm uses the stochastic tournament or the 
anisotropic selection. Thus, the selective pressure needed to 
find the best exploration/exploitation trade-off is dependant 
of the transmission mode of information through the grid. 
Furthermore, the existence of a threshold value for the 
parameter which controls the selective pressure do not find 
explanation in the statistic measures on genotypic diversity 
and takeover time. 

A study of the relations between topologic, phenotypic 
and genotypic distances should give a better explanation 
of performance and as a consequence should explain the 
takeover time and diversity during the search process. In 
order to explain performance of cGAs, we need to study 
the transmission mode of the informations through the grid 
since the ratio between exploration and exploitation seems 
to rely on it. 

Conclusion and perspectives 

This paper presents a comparative study of two selection 
operators, the anisotropic selection and the stochastic tour- 
nament selection, that allow a cellular Genetic Algorithm 
to control the selective pressure on the population. A study 
on the influence of the selection operators on the selective 
pressure is made by measuring the takeover time and the 
genotypic diversity. We analyse the average performance 
obtained on three instances of the well-known Quadratic 
Assignment Problem. A threshold value for the parameters 
of both of the selection operators that gives optimal per- 
formance has been put in evidence. These threshold values 
give the adequate selective pressure on the population for 
the QAP. However, the selective pressure is different for 



the two methods. A study on the genotypic diversity shows 
that the dynamic of diffusion of informations through the 
grid is different when using the stochastic tournament or 
the anisotropic selection operator. The anisotropic selection 
favors the formation of subpopulations in the columns of the 
grid, whereas the stochastic tournament selection slows down 
the propagation speed of the good solutions. The selection 
operator have some influence on the dynamic of transmission 
of the information through the grid and the ratio between 
exploration and exploitation is not sufficient to explain the 
performance of a cGA. 

Nevertheless, we show that even if it is different for the 
anisotropic selection and the stochastic tournament selection, 
the selective pressure has some influence on performances. 
Further works will analyze the dynamic of diffusion of the 
information through the grid and explain the existence of 
a threshold value for the two cGAs by studying statistic 
measures on the relations between topologic, genotypic and 
phenotypic distances. 
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